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EVALUATING PERFORMANCE OF A MULTIPLE-INPUT MULTIPLE 
OUTPUT (MIMO) COMMUNICATIONS LINK 

Field of the Invention 

The present invention relates wireless communications, and more particularly, 
to a method of evaluating the frame error probability of a communications link in a 
wireless telecommunications network. 

5 Description of the Related Art 

In a telecommimications network, an improvement in performance of a 
communication link between a base station and a mobile user terminal does not 
necessarily result in a corresponding improvement in performance of the overall 
network. Accordingly, to evaluate the overall improvement caused by, for example, 

10 introducing Multiple Input Multiple Output (MIMO) signalling between mobile user 
terminals and base stations, the improvement in performance of a large sample of 
links connecting base stations and mobile user terminals needs to be evaluated. 

It is difBcult to acciirately characterise performance of particular links. Such 
perforaiance has traditionally been evaluated in terms of frame error probability, 

1 5 which is often referred to as frame error "rate" and denoted PER, as a function of 

signal-to-interference plus noise ratio (SINK), averaged over all transmission chaimel 
states. Interference, of course, here refers to the interfering signals from other cells, 
and noise is thermal noise. Frame error probability (FER) is the probability that a 
received frame includes at least one error; that is at least one received bit is not as 

20 sent. Calibration curves of FER versus SINK are produced and used to evaluate link- 
level performance. This is adequate for circuit-switched voice-centric radio networks 
where many channel states are encountered over a imit time, such as the duration of a 
coding-block. 

However, it was known that for radio networks running significantly more data 
25 applications, due to the bursty nature of packet switched calls, typically only a small 
number of chaimel states are encountered within the duration of a coding-block. 
Consequently, it had been realised that FER averaged over all channel states 
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encountered during transmission of a coding-block is not a good representation of 
receiver performance for packet switched calls. It had also been realised that a simple 
scalar SINR is not a suitable variable with which to characterise a MIMO scenario, 
where, for example, some spatial correlation between the multiple transmit and 
5 receive antennas occurs. Accordingly, a second known approach was developed in 
which the system-level parameters for a mobile user terminal in a packet radio system 
are related to performance at communication link level by determining MIMO 
channel capacity which is then used to indicate frame error probability. 

Summary of the Invention 

10 An embodiment of the present invention is a method of evaluating frame error 

probability (FER) of a commimications link in a wireless teleconununications 
network. The link is between a MIMO transmitter comprising one of a base station or 
mobile user terminal, and MIMO receiver comprising the other of the base station or 
mobile user terminal. The method comprises determining values of instantaneous 

1 5 channel capacity of a MIMO channel of a mobile user terminal at multiple time 
instants over a predetermined time, processing the values to determine a level of 
channel capacity which any of the instantaneous channel capacity values has a 
predetermined probability of being less than, and looking up said level in 
predetermined calibration data of frame error probability (FER) versus channel 

20 capacity level so as to provide an FER value. 

Example embodiments provide a way of evaluating the performance of 
particular links in MIMO systems in the presence of a fading channel (i.e. non-zero 
Doppler shift), specifically by translating high level parameters, namely channel 
matrix and average signal to noise ratio (Eb/No) for a mobile user terminal linked to a 

25 base station, into frame error probability (FER), which is a measure of link level 
performance. This approach is suitable for fast fading channels (non-zero Doppler) 
being sensitive to the variations over time of the MIMO channel. 

Another embodiment of the present invention relates to a wireless 
telecommunications network comprising a MIMO transmitter comprising one of a 

30 base station or mobile user terminal and MJMO receiver comprising the other of the 
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base station or mobile user terminal. The network includes a processor operative to 
determine values of instantaneous channel capacity of a MIMO channel of the mobile 
user terminal at multiple time instants over a predetermined time, and to process the 
values so as to determine a level of channel capacity which any of the instantaneous 
5 channel capacity values has a predetermined probability of being less than. The 
network includes a look-up memory of predetermined calibration data associating 
frame error probability (FER) with channel capacity level and an indicator operative 
to give an indication proportional to the FER corresponding to the level of channel 
capacity determined. 

10 Brief Description of the Drawings 

An illustrative embodiment of the present invention will now be described by 
way of example and with reference to the drawings, in which: 

Figure 1 is a diagram illustrating a network for mobile teleconununications 
including multiple cells (PRIOR ART), 
1 5 Figure 2 is a diagram illustrating a MIMO transmitter and a MIMO receiver 

(PRIOR ART), 

Figure 3 is a diagram illustrating determination of FER (PRIOR ART), 
Figure 4 is a diagram illustrating determination of FER in a preferred 
embodiment, and 

20 Figure 5 is a diagram illustrating graphically a Cumulative Density Function of 

a channel capacity C for low Doppler shift and high Doppler shift scenarios. 

Detailed Description 

For ease of explanation^ an example of a known approach is described, 
followed by an example of the approach according to the invention. This is for ease of 
25 comparison. 

Known Approach 

In the second known approach referred to previously, system-level parameters 
for a mobile user terminal in a packet radio system are related to performance at 
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communication link level by a variable C which is used to estimate the perfomiance 
of the receiver in terms of frame error probability from pre-computed calibration data. 

Consider a multiple input multiple output (MIMO) system by way of example. 
MIMO techniques are well known, and the reader is referred to, for example, 
5 S.M.Alamouti, "A Simple Transmit Diversity Technique for Wireless 

Communications", IEEE Journal on Selected Areas in Communication, Vol. 16, No. 
8, pp. 1451-1458, October 1998 as background. 

A MIMO system 12 is shown in Figure 2 consisting of a MIMO transmitter 14 
having N transmit antennas 16 and a MIMO receiver 18 having M receive antennas 

10 20. The transmitter 14 is one of a base station and a mobile user terminal. The 

corresponding MIMO receiver 18 is the other of the base station and the mobile user 
terminal. A data block to be transmitted is encoded and modulated to provide symbols 
of a complex constellation. Each symbol is then mapped to the transmit antennas 16 (a 
process known as spatial multiplexing) after some spatial weighting of the signal 

15 components to the various transmit antennas, known in the art as space-time coding. 
After transmission over air, i.e. through the wireless channel, signals received at the 
receiver by the various receive antennas 20 are demultiplexed, weighted, demodulated 
and decoded in order to recover the transmitted data. 

In this MIMO system 12, a radio packet is received via the NxM channel 

20 matrix H, in the presence of additive white Gaussian noise of energy No, Eb being the 
bit energy. Specifically the frame error probability (PER) (for a particular 
conmnmication link , is derivable from the channel matrix H, interference channel 
matrices Hi Hk and thermal noise energy A^o • No structured (i.e. systematic) 
interference is assumed present so Hi ... ,Hk are not considered. 

25 Many computer simulations of the MIMO system 12 were run, specifically of 

the extent to which a transmitted firame 22 would be received for the selected H and 
selected average signal to noise ratio (Eb/No\ the instantaneous noise varying 
randomly over time around an average with a Gaussian distribution. For each 
simulation, comparison of the simulated-received frame 24 to the simulated- 

30 transmitted frame 22 enabled a count to be made of what fraction of the simulated- 
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received frames included at least one error, thus giving a frame error probability 
(FER) value. 

The next step is to determine the channel capacity C to which the FER value is 
related. This was done by assuming FER to be a function of variable C as follows: 

FEP = PrjFrame Error | H,^| = /(C(H,^„iVj) (1) 

enabling calibration curves of the form FER(C) to be produced where 

C=C(H,^6>^o) (2) 
is a scalar variable. C is channel capacity of the MIMO channel H, and is determined 
from a MIMO channel matrix H as: 

C = log2 det[^I^ +-i:^HH» j (3) 

(This is the so-called Shannon capacity formula extended to the MIMO case). C is the 
channel capacity expressed in bits per second per Hertz (bps/Hz) for a MIMO channel 
H with N transmit antennas, M receive antennas, and an average signal to noise ratio 
of Eb/No. 

Accordingly, from the above-mentioned simulations, data of FER against C 
were produced for various average signal to noise ratio. These data are look-up data 
i.e. calibration data to be used to estimate FER for real MIMO systems from 
determination of a C value. 

The use of the variable C to determine FER for a link of a real network is 
shown in Figure 3. For example, by sampling at regular time intervals (e.g. once per 
slot) how signals, namely pilot signals, expected by a mobile user terminal are 
received by the mobile user terminal, a series of "instantaneous" channel matrices H 
for the mobile user terminal of interest at different times is provided. 

For each such "instantaneous" channel matrix H for the mobile user terminal 
of interest, the interface variable C is evaluated in a processor 26 for the particular 
mobile user terminal of interest using Equation (3). The value of variable C is then 
used to estimate FER for that link by looking up the pre-computed link level FER 
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versus C and Eb/No calibration data stored in a memory 28. This is done for each link 
of interest. 

Example Approach 

5 The inventor realised that, in the known approach, being based on 

instantzuieous system level parameters, the C variable value for a link to a particular 
mobile user terminal is produced without taking into account so-called multipath or 
other fast fading characteristics. For static channels, such as a static Additive White 
Gaussian Noise (AWGN) channel, i.e. a channel without fading, this<:hannel capacity 

10 variable C is accurate, but this is not the case for fast fading channels. The inventor 
realised that as fast fading is related to differences in phase between successive 
channel samples, to consider fading (i.e. the effect of Doppler shift) would require 
adapting the variable C to make the variable dependent on channel variations over a 
timeslot or a frame. In other words, a variable was required that is a fiinction of the 

15 differing instantaneous states of the MIMO channel matrix over a period of time, 
namely the time for transmission of a coding-block. This is explained further in the 
rest of this description below, all of which describes an approach according to the 
present invention. 

20 Generating calibration data 

A MIMO system was considered as shown in Figure 2 with a MIMO 
transmitter 14 having N transmit antennas 16 and a MIMO receiver 18 having M 
receive antennas 20, where a radio packet is received via the NxM channel matrix H, 
in the presence of additive white Gaussian noise of energy No, being the bit energy. 

25 The frame error probability {PER) for a particular mobile user terminal, is related to 
the user's channel matrix H, interference channel matrices Hi ... Hk and 
instantaneous thermal noise energy No structured (i.e. systematic) interference is 
assumed present so Hi ... ,HKare not considered. 

Many computet simulations of the MIMO system 12 were run, specifically as 

30 to the extent to which a simulated transmitted frame 22 would be received for the 
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selected H and selected average signal to noise ratio {Eb/No\ the instantaneous noise 
{No) varying randomly around an average with a Gaussian distribution. For each 
simulation, comparison of the simulated-received frame 24 to the simulated- 
transmitted frame 22 enabled a coimt to be made of what fraction of the simulated- 
5 received frames included at least one error, thus giving the frame error probability 
(FER) value. 

The next step was to determine the channel capacity C to which the FER value 
related. This was done by assuming FER to be a function of channel capacity C as 
follows: 

10 FEP = PrjFrame Error | H,^| = /(C(H,E„iVj) (4) 

where an instantaneous value of channel capacity C is determined from a MIMO 
channel matrix H as: 

C = log2 detf +1,^HH«1 (5) 

(This is the so-called Shannon capacity formula extended to the MIMO case). C is the 
1 5 channel capacity expressed in bits per second per Hertz (bps/Hz) for a MIMO channel 
H with N transmit antennas, M receive antennas, and an average signal to noise ratio 
of Eb/No. 

There is then a significant difference from the known approach, namely in 
order to consider fast fading (Doppler), a ftmction denoted which is a stochastic 
20 (i.e. probabilistic) function of C during the time period of interest (e.g. a coding 

block), was determined from the simulation results. This is derived from a Cumulative 
Density Function (CDF) of the instantaneous values of variable C which can be 
considered as describing the variation of the variable C over a coding block. This C, is 
as follows: 

25 C,-arg{Pr(C<CJ = a} (6) 

Co 

This means that Cj is the value of C for which C is below certain level C© with 
probability a. The cumulative density function in respect of C takes the form shown in 
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Figure 5, and the C5 depends on the selected a value, hi use a single value of a is 
selected so as to produce Q values. In a high Doppler scenario (indicated in Figure 5 
by reference numeral 34), any value of a is suitable, e.g. 0.3, 0.5, or 0.7. hi a low 
Doppler scenario (indicated in Figure 5 by reference numeral 36), a value of a near or 
5 at 0.5 is most suitable, as shown in Figure 5, as it is there that the CDF and hence Cs is 
most sensitive to C, 

From the many simulations with various channel matrices H each with various 
instantaneous noise No , various FER versus Cs were determined for various average 
signal to noise ratios (Eb/No). Many simulations were run sufficient to enable look-up 
10 tables, i.e. calibration curves to be produced, from which FER could be read off for 
particular combinations of Cs and Eb/No. 

Using the calibration data 

A network of cells is considered as shown in Figure 1 with at least several 

1 5 mobile user terminals 2 within each cell 4 . Each cell 4 is served by a base station 6 
The instantaneous state of the network 1 is described by all the channel matrices 
corresponding to all the links between mobile user terminals and bast stations. 

By sampling at regular time intervals (e.g. once per slot) how signals, namely 
pilot signals, expected by a mobile user terminal are received by the mobile user 

20 terminal, a series of "instantaneous" channel matrices H for the mobile user terminal 
of interest at different times is provided. 

The method of determining link level performance (in terms of FER) from 
system level parameters (channel matrix H, average signal to noise ratio Eb/No) for a 
mobile user terminal in a real network involving MIMO links is shown schematically 

25 in Figure 4. For the mobile user terminal of interest, variable C value is evaluated in 
processor 30 using Equation (5) for each such "instantaneous" channel matrix H 
This is done repeatedly over a period of time, namely the duration of a coding block, 
and the values of variable C are collected, and the variable Cs is estimated by the 
processor 30 using equation (6) for tliat link (i.e. that mobile user terminal) and that 

30 time period. The value of Cs is then used to estimate FER by looking up the pre- 
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computed FER corresponding to the C and Eb/No data, i.e. frame error probability 
versus C, curves for various Eb/No that are stored in a memory 32. The FER value is 
provided at an output port 33 of the memory 32. (Where appropriate, interpolation 
between calibration data of FER as a function of Cs and Eb/No is undertaken) As Q is 
a function of fast fading (i.e. Doppler), it can adequately account for fast fading in 
evaluating performance of specific links. The processor 30 and lookup table 32 with 
its output port are in the base station, although in other embodiments (not shown) 
these can be located elsewhere in the network, e.g. at a base station controller or other 
node. 

FER is determined in this way for each of MIMO links in a wireless 
teleconununications network, or optionally just those links selected to be 
representative or of particular interest. The set of FER values resulting gives an 
indication of overall system performance, useful for e.g. network apparatus upgrade. 

As Doppler shift increases, i.e. fast fading becomes more significant, the 
absolute value of the slope of the CDF function given in Equation (4) decreases. In 
other words the variance of the variable C over an interleaving block increases when 
Doppler increases. Consequently, Cs given in equation (4) is a decreasing function of 
the amoimt of Doppler shift for probabilities a<0.5 and an increasing ftmction of the 
amoimt of Doppler shift for a>0.5. When a=0.5, the interface variable Cs is equivalent 
to the mean of the instantaneous variable over the period of interest (e.g. coding 
block). 

The variable Cs is backwards compatible with (i.e. gives the same results as) 
the known approach (described above and illustrated in Figure 3) in the case of the 
channel being static, i.e. when Doppler shift is zero. This is because then the 
instantaneous variable C remains constant and therefore for any value of the 
probability a, Cs is equal to the constant value C. 



